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Abstract 

Algebraic curves in Hilbert modular surfaces that are totally geodesic 
for the Kobayashi metric have very interesting geometric and arithmetic 
properties, e.g. they are rigid. There are very few methods known to 
construct such algebraic geodesies that we call Kobayashi curves. 

We give an explicit way of constructing Kobayashi curves using deter- 
minants of derivatives of theta functions. This construction also allows to 
calculate the Euler characteristics of the Teichmuller curves constructed 
by McMullen using Prym covers. 
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Introduction 

We call Kobayashi curves algebraic curves on Hilbert modular surfaces that are 
totally geodesic for the Kobayashi metric. They are rigid and interesting both 
from geometric and arithmetic point of view and there are very few methods to 
construct Kobayashi curves. This paper can be read from two perspectives, the 
construction of Kobayashi curves and the calculation of invariants of Teichmuller 
curves. 

The most obvious Kobayashi curve on a Hilbert modular surface = 
H 2 /SL(o£> © o^,) is the image of the diagonal in H 2 . One can twist it by a 
matrix M € GLj(Q(-/D), i.e. consider the image of z \— > (Mz, M° z) and obtain 
further Kobayashi curves, also known as Hirzebruch-Zagier cycles or Shimura 
curves. These curves are more special, metrically they are even geodesic for the 
invariant Riemannian metric on H 2 . The first Kobayashi curves without this 
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supplementary property, were constructed implicitly in |Cal04| and }McM03j . 
They were constructed as Teichmiiller curves Wd G M2, the name refers to 
their construction using Weierstrafi points. Their image under the Torelli map 
lies in Xd and in this sense the curves Wd generalize the modular embeddings 
of triangle groups in |CW90| that cover some small discriminants D. One can 
apply a twist by a Mobius transformation M € GL^"(Q(V r D)) also to Wd to 
obtain more Kobayashi curves. The geometry of the resulting curves is studied 
in |Weil2j . 

Not all the Kobayashi curves in Xd arise as twists of Wd or of the diagonal. 
In fact, it is shown in [Weil 2] that an invariant (second Lyapunov exponent) of 
a Kobayashi curve is unchanged under twisting. Moreover, the image of other 
Teichmiiller curves Wd(6) constructed in |McM06a] map to curves W£ in Xd 
that are also Kobayashi curves and that have a second Lyapunov exponent 
different from the one of the diagonal and the second Lyapunov exponent of 
W D . 

The first aim of this paper is to construct explicitly modular forms whose 
vanishing loci are these Kobayashi curves W^ . This part is a continuation of 
|MZllj . There, a theta function interpretation of the first series of Teichmiiller 
curves Wd has been found. Having an explicit modular form at hand can be 
used to determine the period map explicitly as power series (whereas this is a 
great mystery from the Teichmiiller curve perspective) and it can be used to 
retrieve all combinatorial properties of Wd (e.g. the set of cusps, etc.) from an 
arithmetic perspective without using the geometry of flat surfaces. 

To state the first result, let 9o, 01,02,^3 be the classical theta constants 
with characteristic (ci,0) for c\ € iZ 2 /Z 2 . The precise definition is given in 
Section[TJ We write /' for the derivative of / in the direction Z2, where (z%, 22) 
are the coordinates in H 2 . 

Theorem 0.1. The determinant of derivatives of theta functions 

#2 (Z) 3 (Z) 

0> 2 {z) 0^z) 

is a modular form of weight (2, 14) for SL(od © D ). Its vanishing locus is the 
Kobayashi curve W^ . 

Determining invariants of Teichmiiller curves is the motivation to a variant 
of this construction for non-principally polarized abelian varieties. From that 
point of view this paper is jointly with the work of |LM11] a continuation of 
|McM06aj . 

Let Wd(6) be the Prym Teichmiiller curves in M.\ and let Wd(4) be the 
Prym Teichmiiller curves in VW3. The notation refers to their construction using 
holomorphic one-forms with a 6-fold resp. with a 4- fold zero. (See Section [T] for 
the definitions and the construction of these curves via flat surfaces.) 
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Theorem 0.2. For the Prym Teichmuller curves Wd(6) C O.M4 the Euler 
characteristic is given by 



X(W D (6)) = -7 X (Xd). 
For genus three and D = 5(8) the locus Wd(4) is empty. For D = 4(8) we have 



X(W D (4)) 



and for D = 1(8) there are two components Wd(4) and Wjj(4) with 



x(w D (4y) 



-jX^ X D,{l,2)) 



for j = 1,2. 



Here n ,2) is the locus in the moduli space of (1, 2)-polarized abclian 
surfaces parameterizing surfaces with real multiplication, a Hilbcrt modular 
surface for some Hilbcrt modular group commensurable to the standard Hilbcrt 
modular groups. We give a precise definition and a way to evaluate explicitly 
the Euler characteristic in SectionQ] The preceding theorem does not prove that 
Wd(4) nor Wai^Y is irreducible. This important result is shown in |LMllj . 
Connectedness of VFd(6) is conjectured in |LM11] with evidence given by small 
discriminants. 

Pictures of the flat surfaces generating the Teichmuller curves Wd, Wd(6), 
Wd(4) are drawn in Figurc[TJ Note that there is presently no algorithm known to 
compute the group uniformizing the curves Wd directly, i.e. using the geometry 
of the generating fiat surfaces, if D is larger than some small explicit constant 
and thus Wd not a rational curve. The same statement holds for Wd(6) and 
for W D (A). 
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Figure 1: Flat surfaces generating respectively the Teichmuller curves Wd, 
W d {6) and W D (4) (from |McM06aj ). 

In order to calculate x(^ / n(4)) we construct Hilbert modular forms for the 
Hilbert modular groups associated with X D x\,2) whose vanishing loci are the 
image curves Wp of x(W£>(4)) in Xd- As for Gp, these Hilbert modular forms 
G D are very 'canonical', determinants of derivatives of theta functions. Their 
precise from is stated in Proposition 13.51 The Euler characteristic of Wd(6) 
is evaluated, too, using modular forms, without ever referring to the geometry 
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of flat surfaces. This strategy was first carried out by Bainbridge ( |Bai07j ) to 
compute the Euler characteristic of the curves Wd- There, on the contrary, the 
modular form cutting out Wd was first described using relative periods, i.e. flat 
surface geometry. 

The construction raises the question to construct more, even to determine 
all Kobayashi curves on Hilbert modular surfaces. The construction of modular 
forms using determinants of derivatives of theta functions has a natural analog 
using higher multiples of the principal polarization and higher order derivatives. 
Yet, showing that these modular forms define Kobayashi curves requires tech- 
niques different from the ones used here. Some speculations in this direction 
are the content of Section [5j 

The core of Theorem lO.f l is Proposition ^. 4l as well as some converse statement 
derived in Section[4] While proving this converse statement it turns out that the 
maps Wd(6) — > W^ and Wr>(4) — > W^ are bijections, hence that introducing 
two names for these curves served for technical purposes only. The proofs of 
both Theorem 10. II and Theorem 10.21 appear at the end of Section SJ 

The author thanks Olivier Dcbarrc, Sam Grushcvsky, Erwan Lanneau, Curt 
McMullcn and Don Zagier for discussions and useful comments. 

1 Background 

In this section we develop the notions of real multiplication, Hilbert modular 
surfaces and their embedding into the moduli space of principally polarized 
abelian varieties in some detail. This is well-known, but the variant for (1,2)- 
polarizations, that we also need, is treated in less detail in the literature. We 
end with some generalities on Kobayashi curves. 

Hilbert modular surfaces. Let o = 0d be the order of discriminant D in 
the quadratic field K = Q(-\/D) with a a generator of the Galois group of 
K/Q. We fix once and for all two embeddings I, i-z : K — > M and implicitly 
use the first embedding unless stated differently. We denote by Xd the Hilbert 
modular surface of discriminant D, i.e. Xd = H 2 /SL(o_d ffi o^). These Hilbert 
modular surfaces parameterize principally polarized abelian varieties with real 
multiplication by Od ■ We give the details to introduce two types of coordinates 
since we will soon also need the non-principally polarized version. 

To a point z = (zx,Z2) G H 2 we associate the polarized abelian variety 
A z = C 2 /A z where A z is the lattice 

A z = {{a + bz l ,a' y + b a z 2 ) T \ a e o D ,b e o D } (1.1) 

We denote the coordinates of C 2 by u = (ui,W2) T and we see that that real 
multiplication is given for A £ Od by A - (ux, U2) T = (Xu%, \ a U2) T ■ Consequently, 
the holomorphic one-forms du\ and du2 on A z are eigenforms for real multipli- 
cation and we refer to u as eigenform coordinates. We also say that du\ is the 
cigenform for t, unique up to scalar, i.e. where A €E K acts by Xdui = t(A) • du\. 
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Note that here and in the sequel we represent the universal covering C 2 of A z 
by column vectors. 
The pairing 

((a,b),(a,b))= r &®(ab-ab) (1.2) 

is integer valued on Od © 0)5 (which we identify with A z ) and unimodular by 
definition of o^,. It thus defines a principal polarization on A z . 

Associated with any choice of Z-basis (771,772) of Od satisfying the sign con- 
vention Ttq (771 772) = +VD there is a symplectic basis of Od © o^, given by 

ai = (m,0) T ,a2 = (7/2,0) T ,&! = (0,^/VD) T ,b 2 = (O^fjVof. 

In this basis of homology and in the eigenform coordinates, the period matrix 
of A z is given by 



n u = (^ v i ''rr;^ : iL ^r^) = \B ;u 



where 



Vi V2 -r) 2 Zi/VD rnz 2 /VD J V V° z 2 



A = B-\ B=[ r >l 7 ? 2 ) . (1.3) 



The change of basis v = (vi,V2) T = A ■ u results in multiplying II U from the 
left by A and gives 

n * = (/ 2 A (o l) AT ) <L4 > 

Since the period matrix of A z is in standard form with respect to the basis 
v = (i>i,i>2) (and a Z-basis of homology) we refer to v as standard coordinates. 

Siegel modular embeddings. Any choice of a Z-basis (771, 772) of Od, defines 
a map if; : H 2 — > H2 that is equivariant with respect to a homomorphism 
^ : SL(o_d © o^,) — > Sp(4, Z) and descends to a map Xd — > A2- This map is 
the inclusion of the locus of real multiplication into the moduli space of abelian 
surfaces. Explicitly, from (|1.4j) we know that 



( z° 2 ) 



where A and B arc defined in (11.31) . If we let 



where a for a G A' denotes the diagonal matrix diag(a, cr(a)), then the equi- 
variance is easily checked. 
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Abelian surfaces with real multiplication and a (1, 2)-polarization. We 

define ^d.(i,2) to be the moduli space of (1, 2)-polarized abelian varieties with 
real multiplication by Od ■ 

Proposition 1.1. The locus X d ,(1,2) is empty for D = 5 (8). The locus X£>,(i,2) 
is non-empty and irreducible both for D = 0, 4 (8) and for D = 1 (8). 

Proof. Suppose that (A = C 2 /A, C) is an abelian variety with real multiplication 
and a (1, 2)-polarization C. Then A is a rank-two Op-modulc with symplcctic 
pairing of signature (1,2). By |Bas62j such a lattice splits as a direct sum of 
Ou-modules. Moreover, although Od is not a Dcdckind domain for D a non- 
fundamental discriminant, any rank-two Ou-module is isomorphic to a© o y D for 
some fractional o £>-idcal a. The isomorphism can moreover be chosen so that 
the symplectic form is mapped to the trace pairing (|1.2|) . In this normalization, 
if NK(a) — h, then the polarization has degree h? . Since all polarizations of 
degree four are of type (1,2), the locus Xujx^) is non-empty if and only if there 
is a fractional Od ideal a with Nq (a) — 2, i.e. if and only if D ^ 5 (8). 
Generalizing (jl.ip we define for any ideal b and z £ H 2 the lattice 

A b z = {{a + bz u a a + b a z 2 ) T \aeb,be o v }. (1.7) 

For D = 0,4 (8) there is exactly one prime ideal o of norm two, so as in the 
principally polarized case one shows that -Xrm 2) = H 2 /SL2(affi o^>) is con- 
nected. 

For D = 1 (8) the prime two splits (2) = aa CT into two prime ideals of norm 
two. Consequently, both H 2 /SL 2 (a © o^) and H 2 /SL 2 (a' T © o^) parameterize 
(1, 2)-polarized abelian varieties with real multiplication by given by C 2 /A£ 
and C 2 /Af . Since — (o)^) <T , the map (1*1,1*2) (7*2,^1) defines for any 
fractional ideal b an isomorphism 

c2 /AL Z2) ^C 2 /A£ iZi) (1-8) 

of abelian varieties. Consequently, H 2 /SL 2 (affi Ojr>) and H 2 /SL2(a CT © o^,) pa- 
rameterized the same subset of the moduli space of (1, 2)-polarized abelian va- 
rieties. ■ 



Period matrices. We choose from now on a symplectic basis of (771,772) 
of Orj, such that (771,2772) is a basis of o and such that the sign convention 

Tr 7 ^ (771772 ) = +y/T) holds. Let P = f J ^ be the diagonal matrix of the type 

of the polarization we are interested in. With this choice of generators, the basis 

oi = (77i,0) T ,a 2 - (2772, Of, 61 = (0, rg/ VD) T , b 2 = (0,tK/VD) t . 

is in standard form with respect to the trace polarization. In this basis the 
period matrix is 

/771 2772 rgzi/y/D -^z 2 /VD\ = f (z x 0\ T \ 
u U 2r?f ^z./Vd m z 2 /VD J V° W /' 
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where 

A-PT\ !>-(» £). (1.9) 

The change of basis v = (vx,V2) T = A ■ u results in multiplying IT U from the 
left by A and gives 

the period matrix for a (1, 2)-polarized abelian surface with real multiplication 
in standard coordinates. 



Euler characteristics. The notion Euler characteristic (of curves and of 
Hilbcrt modular surfaces) refers throughout to orbifold Euler characteristics. 
Let D = J 2 Dq be the factorization of the discriminant into a fundamental 
discriminant Dq and a square of / e N. A reference to compute the Euler 
characteristic of the Hilbert modular surfaces Xjj, including the case of non- 
fundamental discriminants, is |Bai07| Theorem 2.12]. His formula is 



(1.11) 



where /j, is the Mobius function and (|) is the Jacobi symbol. 

The groups SL(od®o d ) and SL 2 (a©o)j) are commensurable. To determine 

the indices in their intersection, we conjugate both groups by ^ ■ This 

takes SL(or> © o^) into SL(o_d © Od), and SL 2 (affi o D ) into SL 2 (affi o D )- The 
two images under conjugation contain 

P a = {(c d) 6 SL2(X) 1 Q ' de ° D > he a ' CG ° D }- (1J2) 

with a finite index that we now calculate. We reduce mod a. Since Ou/a = F 2 , 
the group SL(od (Bod) reduces to the full group SL 2 (F 2 ) and T a reduces to the 
group of lower triangular matrices. Thus [SL(o_d © o^,) : T a ] = 3. 

Suppose the fractional ideal a is not invertible, i.e. 2|/, hence D/4 is also the 
discriminant of a ring. We claim that a -1 = Od/a- In fact, a = (2,x)z for some 
x of norm 4. Then a -1 = (l,x <T /2)z = 0/3/4- Using the claim wc consider r a 
and SL 2 (o ® Od) as subgroups of SL(od/4 © 0/5/4)- Both contain the kernel of 
the reduction mod a to SL 2 (o£>/4/a). The images are groups of lower triangular 
matrices of size 2 and 4 respectively. We conclude that [SL(a fflOfl) : r a ] = 2 in 
this case. 

Suppose that a is invertible. If is a principal ideal, generated by A, then 
conjugation by diag(A, 1) takes SL 2 (o © Od) into SL(od © Od) and r o into the 
transposed group. Hence [SL(affl Od) ■ r o ] = 3 in this case. The general case 
with a invertible behaves similarly. Outside the prime(s) lying over the ideal (2) 
the groups SL(a© On) and r a agree. We localize at o and take the completion. 
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Since 2 J(f, the ideal a now becomes principal and by the preceding argument 
[SL(o © Od) '■ r o ] divides 3. Since the two groups are not the same, equality 
holds. Altogether we have shown the following proposition. 

Proposition 1.2. The Euler characteristic of X D n2) an d °f Xd are related 
as follows. 

X(X D , { 1,2)) _ J 1 if 2 If 



X (X D ) " 1 3/2 if 2 | /. 

Theta functions. Let (A,C) be a P-polarized abelian surface, where P is a 
diagonal matrix, the type of the polarization. If we fix a basis of homology so 

that the polarization is in standard form [ ^ p _ V then A = C 2 /A, where 



A = (P Z) ■ Z 4 and Z S Ha. The classical theta functions with characteristic 
(ci,c 2 ) are given (using standard coordinates) by 

6 CuC2 (Z,v)= J2 e(^(x + ci) T Z(x + c 1 ) + 2 7 ri(x + c 1 ) T (v + c 2 )). (1.14) 

xGZ 2 

The main result we need is that for (ci, c 2 ) fixed, the set 

{e cl+muC2 (z,v), mjer'zVz 2 } (1.15) 

forms a basis of a translate of C by the point c = Zci +c 2 , see |BL04| Section 3]). 

If one wants to work out explicitly the modular forms defining 
(see Theorem I0.1[) and the corresponding modular form for the genus three 
construction (see Proposition ^. 5[) one has to restrict these modular forms via a 
Siegel modular embedding and translate by an appropriate theta characteristic. 
We will determine this characteristic in Proposition 12.21 resp. at the end of 
Section [3] explicitly. 



Good compactifications. Let Xr> (resp. X D (i 2 )) denote a good compact- 
ification of Xr> (resp. of Xjjn^)) in the sense of [Mum77] with boundary di- 
visor B. Hirzebruch's minimal smooth compactification is good, the one con- 
structed by Bainbridge ( |Bai07j ) to study the curves Wd is good, too. Let Wj 
for i = 1,2 denote the line bundles of the natural foliations T\ = {H x {pt}} 
and J-2 = {{pt} x H} of the Hilbcrt modular surface Xd- They extend on the 
good compactification to line bundles with the property ( |Mum77] ) 

O^(logB) = Wl ew 2 . (1.16) 

These compactifications will be used to perform intersection theory. We denote 
the class of line bundles u>i (or divisors like Wp) in the intersection ring of Xd 
(i.e. up to numerical equivalence) by [wj] (resp. by [Wjj]). 



Teichmuller curves and Kobayashi curves. A Teichmuller curve is an 
algebraic curve C with a generically injective map C —> M. g to the moduli 
stack of curves that is a totally geodesic subvariety for the Teichmuller metric. 
On A4 g the Teichmiiller metric agrees with the Kobayashi metric and thus 
Teichmuller curves are also Kobayashi curves in the following sense. 

For any algebraic varity Y we define a Kobayashi curve C in Y to be an 
algebraic curve C together with a generically injective map C —> Y that is 
totally geodesic for the Kobayashi metric. In this paper we will apply this 
notion (besides for M. g ) only for Hilbert modular surfaces Xp. The universal 
covering of Xd is covered by Kobayashi geodesies, but only few of them descend 
to algebraic curves, i.e. to Kobayashi curves onlfl. 

We recall the following characterization of Kobayashi curves from [MVlOj 
to illustrate the various ways to interpret these curves. We will only need the 
implication i) to iv) in the sequel. Note that we changed terminology from 
|MV10j . where the notion Kobayashi geodesic was used for what we now call 
Kobayashi curve. 

Proposition 1.3. Let C — > Xp.p be an algebraic curve in a Hilbert modular 
surface for some polarization P with completion C — > Xp),p- Then the following 
conditions are equivalent. 

i) The curve C is a Kobayashi curve. 

ii) The variation of Hodge structures (VHS) over C has a rank two subsystem 
that is maximal Higgs (see \MV10§ for the definitions). 

Hi) For (at least) one of the two foliation classes uii we have [u>i][C] = x(^d )■ 

iv) There exists (at least) one (of the two) natural foliations J- of Xry.p such 
that the curve C is everywhere transversal to J- . 

v) The inclusion Tc(logC \ C) — > T\ D P (logB)|c splits. 

Proof. The proofs are simplifications of |MV1Q[ Theorem 1.2], since for Hilbert 
modular surfaces the variation of Hodge structures already decomposes into 
rank two summands. Only these two summands are candidates for the maximal 
Higgs sub- VHS. ■ 

Teichmuller curves are generated as SL2(K)-orbits of flat surfaces (A, w), i.e. 
of pairs of a Riemann surface X and a non-zero holomorphic one-form w. The 
moduli space of flat surfaces is a vector bundle minus the zero section over M. g , 
denoted by HAi g . Its quotient by the action of C* is denoted by ¥flA4 g . 

The Teichmuller curve is isomorphic to W/SL(X, uj), where SL(A, w) is the 
affine group of the flat surface, i.e. the group of matrix parts of homeomorphisms 
of X that are affine maps in the uj charts. At the time of writing there is (still) 
no effective algorithm known to determine SL(X, uj), even if this group is known 
beforehand to be a lattice in SL2(K). Examples of flat surfaces generating Teich- 
miiller curves are given in Figure [TJ We explain more conceptually how these 
flat surfaces were constructed as Prym covers in the next section. See e.g. 
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|MT02j or [Molllbj for more background on flat surfaces, the SL2(R)-action 
and Teichmiiller curves. 

2 Prym varieties 

A Prym curve is a (connected smooth algebraic) curve A together with an 
involution p and a supplementary condition. This supplementary condition is 
different in two of our primary references. In [BL04I it is required that the 
Prym variety Prym(A) = Prym(A, p) introduced below naturally acquires a 
multiple of a principal polarization. In [McM06a] the author focusses on the 
case that Prym(A) is two-dimensional, i.e. an abelian surface. Although the 
first terminology seems to be more widely used, we stick to the second since we 
are interested in Hilbcrt modular surfaces and applications to curves on these 
surfaces. 

Prym varieties. Suppose that A is a curve with an involution p and we let 
Y = X/(p). The quotient map tt : A — > Y induces a map 

q : Jac(A) -> Jac(F) 

and wc let Prym(A) be the connected component of the identity of the kernel of 
q. This abelian variety acquires a polarization Oj a c(x)(©)|prym(X) by restriction 
of the principal polarization on Jac(A). We call this polarized abelian variety 
the Prym variety of (A, p). 

Originally, Prym varieties were invented to construct more principally po- 
larized abelian varieties using curve (and covering) theory than just Jacobians. 
Thus, it was required that the polarization on Prym(X) has a multiple of a 
principal polarization. This holds for etale double covers and genus two double 
covers ramified at two points. 

Double covers with two-dimensional Prym variety. In the sequel we 
use the modified terminology of |McM06a] and say that (A, p) is a Prym pair if 
dim(Prym(A)) = 2. This happens for g(X) — 3 with 4 ramification points, for 
g(X) = 4 with two ramification points and also for g(X) = 5 with p fixed point 
free. The last case is less suitable for the construction of Teichmiiller curves, so 
we disregard it here. 

If g(X) = 4, the principal polarization of J&c(X) restricts to a polarization of 
type (2,2) onPrym(A) by (BL04l Corollary 12.1.5]. That is, Jac(x) (Q)\ Flym(x) 
is a positive line bundle on Prym(X) of type (2,2). Consequently, there is a 
line bundle £ on Prym(A) that defines a principal polarization and such that 

C® 2 = 0J ac (x)(@)|prynipO- 

Since £ is a polarization, the Eulcr characteristic is the product of the di 
appearing in the type and there is no higher cohomology, i.e. we have x(£® 2 ) = 
2 • 2 = iT°(Prym(A), C® 2 ). By Riemann-Roch, the self-intersection number of 
£® 2 equals 8 and hence by adjunction the vanishing locus of any section of £® 2 
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is a curve of arithmetic genus five (hence possibly a curve of genus 4 with 2 
points identified to form a node). 

The Prym Teichmuller curves Wd(6) and T4 7 d(4). For g(X) = 4 the 
Prym eigenform locus flEfj is defined in [McM06a] to be the subvariety in 
flA4^ of fiat surfaces (X, u>) such that X admits a Prym involution p such 
that Prym(X) admits real multiplication by Od and, finally, such that uj is an 
eigenform for real multiplication by Od- The eigenform condition includes in 
particular, that uj is in the — 1-eigenspace of the action of p on H (X, fix)- The 
intersection of VlEr, with the minimal stratum is shown in |McM06a] 

to be (complex) two-dimensional. Its image in PSI.M4 is an algebraic curve 
Wd{&) that projects isomorphically to a Teichmuller curve M.\ that will also 
be denoted by Wd(6)- We do not assume here that Wd(Q) is irreducible, but 
by jLMllj this is conjecturally indeed the case. These curves can be generated 
by X-shaped flat surfaces (see Figure [T]). We use this to label their images in 
Hilbert modular surfaces by an upper index X, see below. 

Fully similarly, for g{X) = 3 the Prym eigenform locus VLEd is defined in 
|McM06a] to be the subvariety in fi.M 3 of flat surfaces (X, uj) such that X 
admits a Prym involution p such that Prym(JT) admits real multiplication by 
Op and, finally, such that uj is an eigenform for real multiplication by Ofj- The 
intersection of flErj with the minimal stratum flAi^A) is shown in |McM06a] 
to be two-dimensional. Its image in Pri7W 3 is a curve Wd(4), that projects to a 
Teichmuller curve in Mz the will also be denoted by Wo (4). These curves can 
be generated by S'-shaped flat surfaces (see Figure [T]) and we use this to label 
their images in Hilbert modular surfaces by an upper index S, see below. 

The Abel-Jacobi image In the following lemma the non-hyperellipticity is 
still parallel for Wjj(6) and W£>(4), but in all further steps the two cases differ. 
We thus concentrate on Wjj(6) for the rest of this section. 

If we fix a point P on X, then the composition of the Abel-Jacobi map 
X —> 3ac(X) based at P with the dual of the inclusion Prym(X) — > Jac(X) 
defines a map ip : X —> Prym(X), called the Abel-Prym map (based at P). 
Note for comparison with the case that in this (standard) definition we 
have used the principal polarizations of Prym(X) and Jac(X) to obtain a map 
Prympf) -> Jac(X). 

Lemma 2.1. The curves Wd(6) and Wd{^) are disjoint from the hyperelliptic 
locus. 

Moreover, for each curve [X] € Wb(6) the Abel-Prym map is an immersion 
outside the fixed points of p and maps the two fixed points of p to a single point 
in Prym(X). 

Proof. Suppose (X, p) was hyperelliptic with hyperelliptic involution h. By the 
uniqueness of the hyperelliptic involution (h, p) = (Z/2) 2 . In particular t = hop 
is another involution. Moreover, by |Mum74j Prym(X) = Jac(X/r) and hence 
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the one- form a; is a pullback from X/t. This contradicts that u has a single 
zero of order 6 resp. of order 4. 

The disjointness from the hyperclliptic locus is the hypothesis needed in 
|BL041 Section 12.5] to deduce the remaining claims. ■ 

For the construction of modular forms using theta functions below we need 
a more precise description of the Abel-Prym image in terms of the theta divisor 
on Jac(X) and thus the theta divisor on Prym(X). Let W 3 C Pic 3 (X) denote 
the canonical theta-divisor in the Picard group of X, i.e. the image of the 3-fold 
symmetric product of X in Pic 3 (A"). 

Proposition 2.2. Let (X,tu) be a surface in Wd(Q) and div(w) — 6P. Then 
the spin structure determined by Ox(3P) is even, i.e. h°(X,Ox(3P)) = 2. 

Suppose the Abel-Prym map is based at P. Then the line bundles Oa(<p(X)) 
and Ojac(Jf)(©)U = £ 2 are linearly equivalent, where is the translate of 
W 3 C Pic 3 (X) by -3P. 

Proof. The possible configurations of cylinder decompositions of such a flat 
surface arc listed in the appendix of jLMll) . There are only two of them (one is 
also visible in Figured]). In both cases, the parity of the spin structure can be 
calculated using the winding number of a homology basis (as e.g. explained in 
[KZ03]) to be even. Clifford's theorem implies that for an even spin structure 
h°(X,O x (3P)) = 2. 

A non-hyperelliptic curve X with an even spin structure has a unique divisor 
D of degree three with h°(X, D) > 2. This divisor is the unique singular point 
of the theta divisor (considered in Pic 3 (A)). 

The algebraic equivalence of Oa{v{X)) and Cj a c(x)(©)U = £ 2 is a con- 
sequence of intersection theory, known as Welters' criterion (see |BL04[ Theo- 
rem 12.2.2]. The translation image of a linear equivalence class on an abelian 
variety is precisely the algebraic equivalence class. So we have to show that this 
translation is zero for the two bundles in question. Equivalently, we have to 
show that <p(X) C 9, where we consider ip{X) cic Jac(A) = Pic°(X). since 
<p(X) c Pic°(X) is the set of classes x — p(x), we have to show that 3P+x — p(x) 
is an effective divisor for all x G X. Since h°(X, Ox(3P)) = 2, this is obviously 
true. ■ 

The curve in Xq. For any curve X representing a point [X] £ Wd(6) 
the Prym variety has a principal polarization by C defined above and real mul- 
tiplication by Od by definition. We thus obtain a map Wd(6) —> Xo, whose 
image we now describe. Recall that du\ and du2 are the eigenforms for 
real multiplication on the abelian variety A( ZljZ2 ) in the eigenform coordinates 
u = {ui,U2) introduced in Section [1] Since the abelian varieties A( Zl Z2 j and 
^(z 2 ,zi) are isomorphic with an isomorphism interchanging du\ and du2, we may 
assume in the sequel that du\ is the eigenform with the 6-fold zero. The other 
choice describes the flipped curve t(Wq), where t(z 1 ,z 2 ) = (z 2 ,zi). 
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Description of W§ using theta functions. By Lcmma liOl the Abel-Jacobi 
image of X is cut out in Prym(X) by some section in £® 2 . If we fix a basis 
Qo,Qi,02, &3 of these sections, it is cut out by the vanishing of 



J=0 



i( z , U ) 



for some choice of coefhcients Oj(z). We now determine the coefficients (do : 
. . . : 03), as a projective tuple such that <p(X) = {Ox = 0}. 

First, by the choice of the base point of the Abel-Prym map, the divisor Ox 
has to contain zero, hence 



5>i(*)0i(M) = o 
3=0 



(2.1) 



From Lemma 12.11 we deduce that <p(X) has an ordinary double point at u = 
(0,0). 

Lemma 2.3. Fix the point z S H 2 and assume that the %(z) are chosen such 
that (|2.1[) holds. Then the differential du\ restricted to X has a zero of order 6 
at u = (0,0) if and only if J^#x;(z, u)| u _(o,o) vanishes for k = 1, . . . ,6. 

Proof. If <p(^Q had a single branch through the origin (0, 0) in A z the vanishing 
of these partial derivatives would be exactly a reformulation of an eigenform 
having a 6-fold zero at that point (0, 0). But since by Lemma [2TT1 there are two 
branches through (0,0) the vanishing of these partial derivatives only implies 
that ord(o.o) (dui) > 5. But since (0,0) is a fixed point of p and dui in the 
(— l)-cigcnspace of p the vanishing order ord(o,o)(^ u i) ls even, thus proving the 
claim. ■ 

We use the shorthand notation 9j(z) = 0j(z, (0,0)) and the classical termi- 
nology theta constants for these restrictions. Indices of theta constants are to 
be read modulo 4 in the sequel. For a function /(z, u) the prime denotes the 
derivative f'(z) = -§^f[z, u)| u=(0 ,o)- 

Proposition 2.4. The function 



G£(z) = 5^o 3 -(z)0J"(z), where a {z) 
j=o 



?j+iO) 



^ 2 (z) 



^+3(Z) 



(2.2) 



is a modular form of weight (2, 14) /or SL(o rj © 0^,) and /or some character. Its 



tX 



vanishing locus contains Wjj 
Equivalently, we can write 



r x 



0o(z) 
fo(») 

C( z ) 



0i(z) 
0[(z) 
6'{{z) 
6'{>(z) 



Hz) 



*s(*) 
TO 



(2.3) 
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Hence (up to a scalar) Gp(z) does not depend on the choice of the basis of C® 2 . 

Proof. The functions 6j (z) are modular forms of weight (1/2, 1/2) for a subgroup 
of r finite index of SL(od © o^,). (For Sicgel thcta functions of second order this 
group is the congruence group T(4, 8), so T D ip~ 1 (ip(SL(o D © o^)) n r(4,8)), 
where tp is a Siegel modular embedding. The precise form of T will play no 
role.) First, we claim that the a,j(z) are modular forms of weight (3/2,15/2) 
for the same subgroup T. This is a general principle, extending Rankin-Cohen 
brackets (see e.g. |Zag08| ) to three-by-three determinants. Roughly, the deriva- 
tive of a modular form / of weight (fci,fc2) in the second variable is a modu- 
lar form of weight (fci,fc2 + 2) plus a non-modular contribution. These non- 
modular contributions cancel when taking the linear combinations that ap- 
pear in a determinant. All the summands in the determinant are of weight 
(1/2,1/2) + (1/2,5/2) + (1/2,9/2), thus proving the claim. More precisely, for 

any ^ G SL(od © o^,) we have 

d .,az\ + b a' J z2 + b a . , k d „. . 

w~f( —7, a , ,J = (c*i + d fcl (c a z 2 + <F) k2+2 —f(z u z 2 ) 

0Z2 czi + a c a z2 + a 0Z2 (2.4) 

+ fc 2 C ff (cZ 1 + dp(c°Z 2 + d°) k2 + 1 f( Zl ,Z2). 

Hence {^§^j 9 differs from a modular form in a summand 

k 2 c' J (cz 1 + d) kl {c a z 2 + d a ) k2+1 f ■ g. 

Since this summand is symmetric in / and g, if / and g have the same weight 
and thus the same &2, we deduce the modularity of fg' — f'g. Differentiating 
(|2.4[) once more gives the result for second derivatives and three-by-three deter- 
minants. 

By Lemma [231 on the locus W£ the section -^-^Oxiz, u)| u= ( 0i o) vanishes for 
k = 1, . . . , 5. Vanishing for odd k is automatic, since all the 9i and hence Ox 
is even. By the heat equation ^5*0»(z,u)| u= (;o,o) = ^f^( z )- Thus the a i( z ) 
have to satisfy 

g2k l 3 \ 3 Q k 

g^2k 2Z%( Z )^( Z > U )U=(0,0) =H«j( Z )^^( z ) =0 

2 \j=o y j=o 2 

for fc = 0, 1, 2. The %(z) given in (|2.2[) arc, up to a common scalar factor, the 
unique solution to these conditions. 

We now use the same argument derived from differentiating (|2.4[) again. 
Since 9i(z, u) are modular forms of weight (1/2, 1/2) and the aj(z) are modular 
forms of weight (1/2, 1/2), the sum is a modular form of weight (3/2, 15/2) + 
(1/2, 13/2) = (2, 14) plus a multiple of ^ a,j(z)9" (z), which is known to vanish 
by the choice of the aj(z). 

Finally, we consider the action of SL(o£>©o^)/r. It is known for Siegel theta 
functions that T(2) /r(4, 8) acts by characters and that Sp(2g, Z) /T(2) acts by a 
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linear representation on the basis of £® 2 . These statements obviously also hold 
for ip(SL(on © £>£>))• From the determinantal form of Gp it is obvious that the 
change of basis leaves Gd unchanged. Consequently, G^ is a modular form for 
the full Hilbcrt modular group SL(o£> © o^,) for some character. ■ 

Explicit construction. We may take the classical theta functions (| 1 . 14[) and 

restrict them via a Siegel modular embedding. By Proposition l2.2l no translation 

by a characteristic is required. Consequently, by (|1 . 15|) applied to P = 
and ci = C2 — we obtain the desired basis 9q,. . .,63 used to construct Gp. 

3 A Prym variety with (1, 2)-polarization. 

The aim of this section is a characterization of W§ in terms of derivatives of 
theta functions, parallel to Proposition 12.41 The corresponding modular form 
is constructed in Proposition 13.51 Consequently, in this section we restrict to 
g(X) = 3 and p is an involution on X with 4 fixed points. 

The Abel-Jacobi map revisited. Let l : Prym(X) — > Jac(X) be the 
inclusion of the Prym variety, defined in the preceding section as the connected 
component of the identity of the kernel of q : 3a,c(X) —> Jac(F). The restriction 
of the principal polarization of Jac(X) to Prym(X) is a polarization of type 
(1,2) that we denote by £ = Oj a c(x)(@)|prym(x)- Now, the canonical map 
cf>c ■ Prym(X) — > Prym (X) associated with £ is no longer an isomorphism, 
but of degree 4. Consequently, there is a dual isogeny (4>c) v '■ Prym(JT) — >• 
Prym (X) with the property that (<fic) v ° 4>c = [2] is the multiplication by two 
map. The map (<t>cY is induced by a line bundle £ on Prym v (X) which is also 
a polarization of type (1, 2) (see |BL99j ). The map (4>cY = 4>c depends only on 
the image of £ in the Neron-Severi group, i.e. for the moment £ is well-defined 
only up to translations. 

Still identifying Jac(X) with its dual we have the dual inclusion map I : 
Jac(X) —> Prym (X) and the Abel-Jacobi map ip defined above generalizes as 
the composition of the map X —> 3a,c(X) (still depending on the choice of a 
base point) of with (j>£ o I. We let ipo be the composition of X — > Jac(X) and 
I, so that ip — 4>£ o ip . We call </?o the pre- Abel-Jacobi map and <po(X) the 
pre- Abel-Jacobi image of X. Most of the following lemma is also covered by 
results in [Bar87j . 

Lemma 3.1. The pre- Abel-Jacobi image of X is embedded into Prym v (X). 
The image of the fixed points are two-torsion points in Prym v (X). 

The Abel-Jacobi image of X is embedded into Prym(JT) outside the four fixed 
points of p. These four fixed points are mapped to £ Prym(X). 

The map (—1) on Prym v (X) induces the involution p on X. 

Proof. Recall that the map g v : Jac(Y) — > Jac(X) is given for any degree zero 
divisor D by D M> D + p(D). The map I is the quotient map by the image of 
q y . Hence two points D\ and Z?2 are the same in Prym v (X), if and only if they 
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differ by an element of the form D + p(D). This implies that a fixed point of p 
maps to a point of order two in Prym (X) and the last statement. 

The Prym variety Prym(A) is the complementary subvariety to Jac(y) in- 
side Jac(X) in the sense of |BL04[ Section 12.1]. Consequently Prym(AT) is 
the image of (1 + p) : Jac(X) — > Jac(X). Suppose that ip(x) = ip(y). Then 
(x — P) + (p(x) — P) ~ [y — P) + (p{y) — P), hence x — p(x) ~ y — p(y). Since 
X is not hyperclliptic, this can only happen if x and y are both fixed point of 
p. This implies the pointwise injectivity for both ipo and (p outside the fixed 
points. 

Let Pi denote the images in Y of the fixed points of p. The projectivised 
differential of the Abel-Prym map is the composition X — > Y — > P(£T°(CV® ??)) 
where 77 is a line bundle defining the double covering, i.e. r)® 2 = Oy(P\ + P2 + 
P3 + Pi)- The Abel-Prym map is not an embedding at a point x, if and only if x 
is a base point of Oy®t), i.e. if h°(Oy ®v) = h°(Oy <8?7(— a;)). (Details on both 
statements can be found in jBL04[ Proposition 12.5.3 and Corollary 12.5.5], the 
principal polarization hypothesis is not used.) On a curve of genus one the 
bundle Oy is trivial and since deg(r)) = 2, Riemann-Roch implies the claim. 

It remains to show that the images of the fixed points of p are actually 
distinct in Prym (X). If not, then for some fixed point Q we have Q — P ~ 
D + p(D) for some degree zero divisor D on X. Since Y is an elliptic curve, 
hence equal to its Jacobian, we may moreover suppose that D ~ (R — P) for 
some point R £ X. Together we obtain Q + P ~ R + p(R), which contradicts 
that X is not hyperelliptic. ■ 

Lemma 3.2. For a flat surface [X, w) parameterized by Wd{^) the parity of 
the spin structure is odd. 

Proof. This can be checked on any flat surface representing (X, u>) using the 
winding number definition given in |KZ03j . Alternatively, we can use the clas- 
sification of strata in |KZ03j together with Lemma 12.11 stating that we are not 
in the hyperelliptic stratum. ■ 

We denote by K(C) C Prym v (A) the kernel of <j>£. It is shown in |BL04i 
Lemma 10.1.2] that a polarization £ of type (1,2) on an abelian variety has 
exactly 4 base points of the linear system |£|, i.e. there are exactly 4 points that 
all the vanishing loci of sections in H (£) have in common. Moreover, the 4 
base points form one orbit under the translation by K(C). 

Lemma 3.3. There is a unique choice of C within its algebraic equivalence class 
such that zero is a base point of C. 

With this choice of C, if the flat surface (X,u>) lies in W^d(4), then the 
pre- Abel- Prym image tpo(X) is the vanishing locus of some section in H (£)). 
Moreover (— 1)*£ = £ with this choice of C, and all the global sections of £ are 
odd. 

A similar statement does not seem to hold for the Abel-Prym image. By 
Lemma |3. II it has arithmetic genus 6 and the obvious polarizations on Prym(X) 
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are of type (1,2) or maybe (1,4). By adjunction the vanishing loci of their 
global sections are curves of arithmetic genus 3 or 9 respectively. 

In the sequel we use the endomorphism 5(C,D) associated with a curve C 
and a divisor D of an abelian variety A. It is defined by mapping a € A to the 
sum of intersection points of the curve C translated by a and the divisor D. 

Proof. Recall that the algebraic equivalence class of a line bundles consists ex- 
actly of its translations by any point in Prym(X) v . Two translations of £ that 
have zero as base point differ by an element in K(C). But for c £ K{C) we have 
t* c C ~ C by definition of <f>£. This proves the first statement. 

For the second statement we first show that <fio(X) and C are algebraically 
equivalent. Following the strategy in [BL041 Lemma 12.2.3] we need to show 
by [BL041 Theorem 11.6.4] that %„(X),£) = S(C,C). By (BL041 Proposi- 
tion 5.4.7] we have 5(C, C) = — 2idp rym v(j 5(: '). On the other hand, still identifying 
Jac(X) with its dual using the polarizations O we have 

$(<Po(X), C) = -to to 4>£ — —(p c = -2id Prym v( X ) 

by [BL041 Proposition 11.6.1], by definition of C as restriction of Oj ac (jf) an d 
by definition of C. 

Next, we check that we correctly normalized C within its algebraic equiv- 
alence class. If two points in (fio(X) differ by an element in K(C), they are 
mapped to the same point in (p(X). By Lemma 13.11 this happens for any two 
points among the fixed points of p and for no other pair of points. Since the 
base points of C differ by elements in K(£), this implies the claim. 

The last statement is a special case of the results in [BL041 Sections 4.6 
and 4.7]. ■ 

The curve in Xp .(1,2) • We keep the normalization of £ within its al- 
gebraic equivalence class from now on. For any curve representing a point 
[X] G Wd(4:) the Prym variety has a polarization by C of type (1,2) de- 
fined above and real multiplication by Od by definition. We thus get a map 
W_d(4) — > X D ( lj2 ), whose image we now describe. Recall that du\ and dui 
are the eigenforms for real multiplication on the abelian variety Ar Zl>Z2 ^ in the 
eigenform coordinates u introduced in Section [TJ 

For D = (4) we may suppose that du\ is the eigenform and that the abelian 
varieties in ^0.(1,2) are = C 2 /A°, compare (|1.8[) . For D = 1 (4), however, 
we have to replace a by a a , when insisting on this normalization. This will play 
a role in the next section. 

We can now strengthen the previous lemma using the real multiplication 
and the 4-fold zero condition. 

Lemma 3.4. If the image of the flat surface (X, to) lies in W^, then there exists 
some section 6x of H°(A Z , L) such that the partial derivatives 

Qk 
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for k = 0, . . . , 4 vanish at the point u = (0, 0). 

Since c was chosen in the base locus of C and since the sections of C are odd, 
the vanishing of the derivatives for k = 0, 2, 4 is automatic. Wc now express the 
vanishing for k = 1 and k — 3 in terms of theta functions. 

We now fix a basis {0q(z, u), #i(z, u)} of sections of £. We define 

Q 

£>20j(z) = ^-0j(z,u)| u=( o )O ) for J = 0,1 
and for analogous purposes as in Section [5] we let 

aj (z) = (-iyD 2 e j+1 (z). 

Recall from the previous section the definition /'(z) = -7^-f(z, u)| u= ( .o)- 

Proposition 3.5. Let a be a fractional OD-ideal of norm two. Then the function 
Q3 q3 

Gd = ao(z)^|^o(z,u)| u=(0!0) +ai(z)^-|6»i(z,u)| u=(0j0) 

D 2 9 Q {z) £> 2 0i(z) 
D 2 9' {z) D 2 9[(z) 

is a modular form of weight (1, 5) for the Hilbert modular group SL(a©O v ). The 
union of the vanishing loci of Gf, for the one or two choices of a ( depending 
on D = (4) or D = 1 (8) ) contains the image of the Teichmuller curve 
Wb(4) in the real multiplication locus X D ^ 12 y 

Proof. By the definition of c both 6q and 0\ vanish at u = (0,0). Since the 
Qj are modular forms of weight (1/2,1/2) it is an immediate consequence of 
the transformation formula for theta functions and this vanishing property that 
D 2 9j is a modular forms of weight (1/2,3/2) for some subgroup of the Hilbert 
modular group. By the principle of the construction of Rankin-Cohen brackets, 
Gf, is a modular form of weight (1/2, 3/2) + (1/2, 7/2) = (1, 5), as claimed. 

For the second statement, note that 0x(z, u) = ao(z)#o(z, u) + ai(z)#i (z, u) 
is a section of C whose first two partial derivatives in the ^-direction vanish at 
(0,0). The vanishing of Gf, implies the vanishing of the third partial derivative 
and also the forth derivative vanishes, since Ox is odd. Lemma 13.41 now implies 
the claim. ■ 

Explicit construction. The classical theta functions (| 1 . 14[) with character- 
istic c = are even functions in v (and u). More generally, a shift by a half- 
integral characteristic c = {c\,c 2 ) e (\l?) 2 is an even function, if ic[c 2 is 
even and odd otherwise. Consequently, for a (1, 2)-polarized abelian variety, 
both 9q = ) (i o) and 9\ = 9^i i j ^ i ^ are odd functions, and sections of 
the same line bundle by (|1.15l) . Since these functions are odd, zero is a base 
point of the global sections of the theta line bundle shifted by the characteristic 

c = Z ( n ) + (n J • Consequently, 9q and 9\ are an explicit form of the basis 



v / V , 
needed to construct G^. 
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4 Euler characteristic of Wp and 

The preceding thcta-function interpretation gives a way to calculate the Euler 
characteristic of W£ and W£, and of the Tcichmiiller curves Wr>(6) and Wc(4). 
In this section we prove all the results announced in the introduction and cross- 
check our calculations of Euler characteristics with the examples in IMcM06a] . 
We invite the reader to compare this result to the work of Bainbridge |Bai07j . 
He computed the Euler characteristics of the Teichmiiller curves Wd using a 
modular form that he defined using flat geometry. His formula is 

x{Wd) = -\x{X d ). (4.1) 

Subsequently, a theta function construction of his modular form was found in 
[MZllj . 

Theorem 4.1. For the Kobayashi curves and for the Prym Teichmiiller 
curves VFd(6) C Mi the Euler characteristic is given by 

X(W$) = x(W D (6)) = -7 X (X D ). 

The explicit formula for x{Xd) is stated in (11.111) . 

Example 4.2. For D = 8 we have x(X 8 ) = -1/6 and thus x(W 8 (6)) = 7/6. 
This corresponds to the curve V(Xi) calculated in |McM06a] with genus zero, 
two cusps and two elliptic points of order two and three respectively. 

For D = 12 we obtain x(Xi 2 ) = -1/3 a nd thus x (W 12 (6)) = 7/3. This 
corresponds to the curve V(X^) calculated in McMOGa with genus zero, three 
cusps, one elliptic point of order two and one elliptic point of order six. 

Theorem 4.3. For genus three and D = 5(8) the locus VFd(4) is empty (and 
Wjj is not defined). For D = 4 (8) we have 

X(WE) = X{W D {A)) = -^ x (X n ,(i,2)). 

For D = 1 (8) there are two components M / £>(4) 1 and Wd^) 2 , each mapping to 
a Kobayashi curve in X D (i_ 2 ) and the Euler characteristic is given by 

x(W% j ) = x(W D (4Y) = ~ X (X DiilA ) for j = 1, 2. 

Example 4.4. For D = 12 we have x(Xi2) = x(^i2,(i,2)) by Proposition 11.21 
Hence x(^i2,(i,2)) = — 1/3 as in the preceding example and thus x(Wvi) = ^/®- 
By |LMllj the locus Wi2(4) for this discriminant has one component only. It 
corresponds to the curve V(Si) calculated in |McM06a] with genus zero, two 
cusps and one elliptic points of order six. 

For D = 20 we have x(^20,(i,2)) = 3/2x(^2o) by Proposition 11.21 Conse- 
quently, x(^20,(i,2)) = 1 and thus x(^ 2 o) = 5 / 2 - B Y jLMllj the locus VF 20 (4) 
for this discriminant has one component only. It corresponds to the curve V(S2) 
calculated in |McM06a] with genus zero, four cusps and one elliptic point of or- 
der two. 

The proof of both theorems will be completed at the end of this section. 
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A Torelli-type theorem. The Prym-Torelli map associates with any Prym 
pair (X, p) (or equivalently with a (quotient) curve Y and the covering datum) 
its Prym variety. For g(X) = 4 we have g(Y) = 2 with two fixed points, thus 
a moduli space of dimension 5. Since dim A2 = 3, there cannot exist a Torclli 
theorem retrieving the curve from its Prym variety. Nevertheless, a correspond- 
ing statement holds when restricted to real multiplication and eigenforms with 
a zero of high multiplicity. 

Proposition 4.5. Let (A Z ,C) be a principally polarized abelian surface with 
real multiplication by Od and suppose that the corresponding point [A z ] G Xd is 
in the vanishing locus of G^ . Then there is one and only one curve X of genus 
four with [X] € Wd{6) whose Prym variety is A z and such that the eigenform 
with a 6-fold zero is du\. 

In particular the vanishing locus of G^ is equal to . 

Proof. We reverse the reasoning in the construction of Gp. Take a basis 
Oq(z, u), . . . , 6*3 (z, u) of sections of £® 2 and choose Oj-(z) as in (|2.2[) (where we 
now work with partial derivatives in the ^-direction of order 0,2 and 4, to avoid 
^-derivatives in this pointwise argument). Now let 

3 

6» A -(z,u) =^a j (z)0 i (z,u) 

3=0 

and define X' z to be the vanishing locus of Ox- One easily checks that the 
function Ox does not depend on the choice of the basis for £® 2 . 

Suppose that Ox is not zero. By Riemann-Roch and adjunction, X' z is a 
curve of arithmetic genus 5. Since all these sections of £® 2 are even and since 
X' x passes through the origin of A z , it has a singularity there. The vanishing 
of the derivatives implies that on the branch of X' z at zero in the direction u\ 
the one- form du\ has a zero of order at least 5. Hence the geometric genus 
of X' is at least four and hence the singularity at the origin is just a normal 
crossing of two branches. Since Ox is even, du\ has in fact a zero of order 6 at 
the origin. By Welters' criterion for a curve to generate a Prym variety f |BL04[ 
Theorem 12.2.2]) the normalization X z of X' x is a curve of genus four with an 
involution p induced by u h-> — u and A z is the Prym variety of (X,p). We 
conclude that X z £ Wd(6). This shows that there is a curve Wd(6) whose 
Prym image is A z and by the argument leading to Proposition 12.41 the curve X 
just constructed is the only choice with du\ restricting to a zero of order 6, if we 
can rule out that all the Oj (z) are zero, which is equivalent to the assumption 
Ox 7^ 0. Together with the inclusion stated in Proposition 12.41 this concludes 
the proof of the proposition under the assumption on Ox ■ 

Suppose that Ox was zero for some z € H 2 . This implies that all the <Zj(z) 
vanish. Consequently, if we let 

/0„(z) 0i (z) 2 (z) 3 (z)\ 
M=\0' o (z) 0i(z) 9' 2 (z) 0' 3 (z)\, then rank(M) < 2. (4.2) 
V^'(z) 0'{(z) 0£(z) {%(*)) 
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The image of A z under the projective embedding A z — > P 3 defined by the 
sections of L® 2 is known to be a Kummer surface, the quotient of A z by the 
involution (—1) (see |BL04[ Section 10]). Such a Kummer surface has 16 nodes 
at the images of two-torsion points, i.e. singular points with local equation x 2 + 
y + z 2 = 0. Since the Hessian of such a singularity has non-zero determinant, 
this contradicts the above hypothesis rank(M) < 2. ■ 

The same line of arguments works for g = 3, with a different geometric 
argument to rule out Ox = and with an extra twist due to the decomposition 
behavior of the prime two. 

Proposition 4.6. Fix a fractional Op-ideal a of norm two and a realization 
Xd.(i,2) — H 2 /SL(a © <>£))■ Let (A Z ,C) be a (1,2) -polarized abelian surface 
with real multiplication by Od and suppose that the corresponding point [A z ] £ 
Xd,(i,2) ^ in the vanishing locus o/Gf,. Then there is one and only one curve 
X of genus four with [X] £ WfJ whose Prym variety is [A z ] and such that the 
eigenform with a A-fold zero is du\. 

Moreover, if D = 1 (8), the preimages W r o(4) 1 and W_d(4) 2 in Ma of the 
vanishing locus of Gf, for the two choices a and a a of a prime ideal of norm 
two are generically different. 

Proof. To prove the first statement, we reverse the argument of Proposition [33] 
and use the notations introduced there. Fix a basis #o( z 7 u ), 6i( z , u ) of sections 
of L and consider 9x = clq(z)0q + cli(z)6q. Suppose that Ox is not zero. Then 
the vanishing locus X = {Ox = 0} is a curve of arithmetic genus three and 
by construction du\ is a holomorphic one-form on X with a zero of order (at 
least) 4 at £ X . This implies that X is smooth. Since by Lemma I3~3l the map 
(— 1) on A z induces an involution on X with 4 fixed points, we conclude that 
[X] £ Wd(4:)- This shows that there is a curve W.d(4) whose Prym image is A z 
and by the argument leading to Proposition 13.51 the curve X just constructed 
is the only choice with du\ restricting to a zero of order 4, if we can rule out 
that both D 2 o (z,0) = -a x (z) = and D 2 9 1 (z,0) = a (z) = 0. Together with 
the inclusion stated in Proposition 13.51 this implies the first statement of the 
proposition under the assumption on Ox ■ 

Suppose that 9x was zero for some z £ H 2 , i.e. ao(z) = a\(z) = 0. Consider 
the family of arithmetic genus three curves given by the vanishing locus of 
o,0q + bOi parameterized by (a : b) £ P 1 . If we blow up the four base points of C 
in A z we obtain a fibered surface with Euler number —4. If all the fibers were 
smooth, the formula for a genus three fiber bundle over a projective line gives 
Euler number —8, a contradiction. The possible singular fibers of a section of C 
are determined in |Bar87j . see also |BL041 Exercise 10.8.(1)]. The first possibility 
is a genus two curve with one node, necessarily disjoint from the base points, 
the other two possibilities consist of configurations of elliptic curves. (They can 
occur only on some modular curves in X D ( 12 ), but we will not use this.) Since 
ciq = cii = 0, the holomorphic one-form du\ restricted to any global section 
of C has a zero of order at least two at zero. This already rules out all the 
configurations of elliptic curves. 
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Still assuming that ao = a\ = 0, we consider the fibered surface f : X = 
Blowup 4 p oints (A z ) — > F 1 all whose singular fibers are of geometric genus two. 
By Lemma 13.31 all the fibers admit an involution p induced by (—1) with (gener- 
ically) 4 fixed points. The quotient is thus a curve of arithmetic genus one. 
Since for the singular fibers the 4 base points are disjoint from the node, the 
arithmetic genus one curve is smooth if and only if the corresponding fiber of 
/ is smooth. We claim that this implies that / is a pullback of a Tcichmiillcr 
curve generated by a square-tiled surface, whose family of Jacobians has a two- 
dimensional fixed part, the abelian surface A z . In fact, consider the image of 
the moduli map P 1 — > M3. The image is embedded in 7W3, so its tangent 
map, the Kodaira-Spencer map, vanishes nowhere. Since the 2-dimensional 
abelian subvariety A z of the family of Jacobians is constant, this implies that 
the Kodaira-Spencer map of the quotient family of elliptic curves X / (p) never 
vanishes. Together with the statement on singularities the hypothesis for the 
characterization of Teichmiiller curves |BM1Q[ Theorem 1.2] are met. 

The claim implies that this fibered surface also defines a Shimura curve 
and by jMolllal Lemma 4.5], the singular fibers of such a family cannot be of 
geometric genus two, more precisely, the fibered surface / has to be the unique 
such curve in M3, described in detail in |Molllal Section 3] or in |HS08j . This 
contradiction concludes the proof that Ox is nowhere zero. 

For the second statement we look at the periods of the eigenform u with a 
4- fold zero using our conventions The periods of the first eigenform are, 

by definition, o o v D z for some z £ H (as opposed to a a © o y D z for the second 
eigenform). If the two components Wr)(4) 1 and Wd{4) 2 coincided at some point 
the two eigenforms would lie on the same abelian surface with real multiplication 
and (1, 2)-polarization. We thus would obtain an On-linear isomorphism 

o® 0^ = a 17 8 o y D . 

Taking determinants of both sides we obtain a = a CT , contradicting D = 1 (8). 

■ 

The last argument is given in coordinates on flat surfaces explicitly in [LM111 
Lemma 6.2], and serves for the same purpose of distinguishing the two compo- 
nents. 

We can now collect all the information and prove all the theorems stated in 
the introduction as well as at the beginning of this section. 

Proof of Theorem \0.1\ Proposition 12.41 and 14.51 prove the first statement of the 
theorem. For the second statement, note that the proof that Wd(6) is a Teich- 
miiller curve uses the fact that universal covering of W ^ T± oi C ^ M4 
composed with the Torelli map T — > H4 to the Siegel upper half space can 
be composed with a projection H 4 -> i so that the composition is a Mobius 
transformation, hence a Kobayashi isometry. The non-expansion property of 
the Kobayashi metric implies that H — > Ta is a Kobayashi curve. Since H4 — > 
H was constructed using the periods of the eigenform with a 6-fold zero, the 
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composition 

H -> % -> M 4 -> H 

factors through the universal covering map H — >• M 2 of — > X^. By the 
same argument, this is a Kobayashi curve. I 

Proof of Theorem \4-l\ Using the definition of the line bundles uji along with 
(II.IGP , the class of the vanishing locus of a modular form is 

[W£] = [wi] + 7[W2]. (4.3) 

Since [M 7 ^] is a Kobayashi curve with the isometric embedding given by the 
first variable, we have — = x(Wd )• Thus, pairing (|4.3[) with —[u>i] 

and using that [wi]^] = x(-^d) on a Hilbert modular surface gives the desired 
result. ■ 

The proof of Theorem \4. 3\ follows from the same intersection argument. The 
proof of Theorem ] 0.2\ is now an immediate consequence of Theorem 14.11 together 
with Proposition 14.51 and Theorem 14.31 together with Proposition 14.61 



5 An invariant and possible generalizations 

Aiming to construct more, essentially different Kobayashi curves one can use 
the procedure involving theta functions to construct Hilbert modular forms of 
non-parallel weight generalizing the preceding construction. Of course we thus 
leave the world of Tcichmullcr curves. We propose replace the integer 2 (type 
of the polarization) in the genus four discussion by an arbitrary N € N. First, 
we start with the definition of an invariant. 

Suppose that C Xq is a Kobayashi curve and let C — > Xu the closure in 
a good compactification of Xp. We define 

x 2 (c) = MiS 

and call this ratio the second Lyapunov exponent of the Kobayashi curve. Al- 
though wc defined the intersection number on a compactification, the value of 
A2 is independent of the choice of a compactification since [u>»] • [Bj] for i = 1,2 
and all components Bj of the boundary divisor B. Justification for the termi- 
nology, i.e. the relation to a Lyapunov exponent for the SL2(lR)-action is given 
in [Weil2j . implicitly also in the last section of |Molllbj . 

The Propositions 12.41 13.51 14.51 and 14.61 can in this language be summarized 
as follows. 

Proposition 5.1. Each of the Hilbert modular surfaces Xd contains Kobayashi 
curves of second Lyapunov exponent 1, 1/3 and 1/7. The Hilbert modular sur- 
face X5 moreover contains Kobayashi curves of second Lyapunov exponent 1/2. 
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Proof. Hirzebruch-Zagier cycles gives A 2 = 1, the curve Wd give A2 = 1/3, the 
W£ are curves with A2 = 1/7. The decagon generates a Teichmuller curve with 
A 2 = 1/2 in ( [McM06b] ). ■ 

Problem 5.2. What is the set of second Lyapunov exponents for Kobayashi 
curves in ? 



The same question can be formulated for Hilbert modular surfaces of other 
genera, e.g. in Xd,(i,2) the curves have A2 = 1/5. 

There is an obvious generalization of the construction of G^ . The (Hilbert) 
theta functions 0(ci, 0)(z, u) for c\ <G 4fZ 2 /Z 2 are a basis of £® N on the abelian 
variety A x . Numbering elements in -^-Z 2 /Z 2 by 0, . . . , A^ 2 — 1 we obtain theta 
functions 8 Q , . . . , 9 N 2_ 1 . We let 



'0 



(z) e\ 



(N 2 -l) 



6>jv=-i(z) 



'N 2 -iy 



As in the proof of Proposition 12.41 we conclude that G^P is a modular form of 
weight (^!,^(2iV 2 -l)). 

Problem 5.3. Is the zero locus of G^ irreducible? Are its components Koba- 
yashi curves in Xjj? 

A positive answer to this problem would at least show that the set of sec- 
ond Lyapunov exponents for Kobayashi curves in Xo is infinite, containing the 
values A 2 = 2jv ^_ 1 . 
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